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We  show  that  several  well-known  results  about  continuous  linear 
operators  on  Banach  spaces  can  be  generalized  to  the  w.'der  class  of 
convex  processes,  as  defined  hy  Rockafeiiar.  In  particular,  the  open 
mapping  theorem  and  the  standard  bound  for  th?  norm  of  the  inverse  of 
a  perturbed  linear  operator  can  be  extended  to  convex  processes.  In  the 
last  part  of  the  paper,  these  theorems  are  exploited  to  prove  results 
about  the  stability  of  solution  sets  of  certain  operator  inequalities  and 
equations  in  Banach  spaces.  These  results  yield  quantitative  bounds 
for  the  displacement  of  the  solution  sets  under  perturbations  in  the 
operators  and/or  in  the  right-hand  sides.  They  generalize  the  standard 
results  on  stability  of  unique  solutions  of  linear  operator  equations. 
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We  show  that  several  well-known  results  about  continuous 
linear  operators  on  Banach  spaces  can  be  generalized  to  the  wider 
class  of  convex  processes,  as  defined  by  Rockafellar.  In  particular, 
the  open  mapping  theorem  and  the  standard  bound  for  the  norm  of 
the  inverse  of  a  perturbed  linear  operator  can  be  extended  to  convex 
processes.  In  the  last  part  of  the  paper,  these  theorems  are  exploited 
to  prove  results  about  the  stability  of  solution  sets  of  certain 
operator  inequalities  and  equations  in  Banach  spaces.  These  results 
yield  quantitative  bounds  for  the  displacement  of  the  solution  sets 
under  perturbations  in  the  operators  and/or  in  the  right-hand  sides. 
They  generalize  the  standard  results  on  stability  of  unique  solutions 
of  linear  operator  equations . 
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Stephen  M.  Robinson 

1.  Introduction.  The  idea  of  a  convex  process  was  introduced 
by  Rockafellar  [9,10]  in  connection  with  general  studies  in  convexity. 

If  X  and  Y  are  real  linear  spaces,  a  convex  process  from  X  into  Y 
is  a  mapping  of  points  in  X  into  subsets  of  Y,  whose  graph  is  a 

convex  cone  in  X  xY  containing  the  origin.  If  the  graph  is  also 

closed,  then  we  refer  to  a  closed  convex  process.  Here  we  are 
using  the  definition  of  graph  as  given  in  [10] :  for  a  mapping  T, 

graph  T:=  {(x,y)|y  e  Tx}. 

An  equivalent  way  of  stating  the  above  definition  is  to  say  that  a 
mapping  T  is  a  convex  process  if  it  satisfies  the  following  three 
requirements : 

a.  T(x  +  z)  3  Tx  +  Tz  for  all  x,  z  e  X. 

b.  T(kx)  =  X.Tx  for  every  \  >  0  and  every  x  e  X. 

c.  0  e  TO. 

It  is  clear  that  any  linear  transformation  (considered  as  a  point-to-set 
mapping)  is  a  convex  process,  but  not  vice  versa.  Just  as  with  linear  trans¬ 
formations,  we  can  define  the  concepts  of  domain,  range  and  inverse:  for  a 
convex  process  T,  dom  T  is  the  set  of  points  x  for  which  Tx  *  ft,  range  T 
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is  U{Tx|x  e  dom  T),  and  T  *  is  a  mapping  from  range  T  onto 
dom  T  with  Ty  :  =  {x|y  e  Tx}.  Note  that  dom  T  and  range  T  are 
both  convex  cones  containing  0,  since  ti  ey  are  the  projections  of 
graph  T  into  X  and  Y  respectively.  Finally,  if  X  and  Y  are  normed, 
we  can  define  the  norm  of  T  by 

II T II  :=  sup{inf  {JJyll  lyeTx})  ||x||  <  1,  x  e  dom  T}. 

The  above  definitions  are  taken  from  [9]  and  [10],  except  that 
the  definition  of  II T II  is  changed  slightly  from  that  given  in  [  9  ] ; 
the  change  affects  only  the  class  of  convex  processes  with  domain 
(0). 

Note  that  there  are  some  changes  from  the  theory  of  linear 

operators:  for  one  thing,  every  convex  process  has  an  inverse, 

and  it  is  easy  to  see  that  the  inverse  is  Itself  a  convex  process.  On 

the  other  hand,  any  linear  operator  between  finite- dimensional 

normed  linear  spaces  has  a  finite  norm,  but  this  is  no  longer  true 

for  convex  processes;  an  example  of  a  closed  convex  process  from 
2 

JR  into  1R  with  infinite  norm  is  given  in  Section  2. 

We  shall  call  a  convex  process  normed  if  its  norm  is  finite. 

In  view  of  the  example  just  cited,  the  question  naturally  arises: 
when  is  a  convex  process  normed?  Also,  if  a  convex  process  is 
normed,  when  can  we  be  sure  that  its  inverse  is  also  normed? 

Finally,  if  T  and  T  *  are  normed,  and  if  we  perturb  T  slightly  by 
adding  to  it  another  convex  process  of  small  norm,  can  anything  be 
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said  about  the  norm  of  the  inverse  of  the  perturbed  process;  specifically, 
can  that  norm  be  bounded?  These  are  questions  that  often  arise  in 
applications,  and  in  the  case  of  linear  operators  on  Banach  spaces 
they  can  be  answered  in  a  very  satisfactory  manner. 

In  this  paper  we  show  how  these  and  other  questions  can  be  answered 
for  convex  processes;  in  fact,  several  of  the  well-known  results 
from  the  theory  of  linear  operators  can  be  extended  to  convex 
processes  in  very  nearly  the  same  form. 

We  conclude  this  section  by  explaining  some  notational 
conventions  that  we  shall  use  in  what  follows.  All  linear  spaces 
from  this  point  on  will  be  assumed  to  be  over  the  real  field.  If 
two  convex  processes,  say  S  and  T,  are  defined  from  a  linear  space 
X  into  another  linear  space  Y,  then  their  sum,  S  +  T,  is  the  mapping 
defined  by  (S  +  T)(x)  :=  Sx  +  Tx.  If  X  is  a  real  number,  then  the 
mapping  XT  is  defined  by  (XT)(x)  ;=  X(Tx).  Both  of  these  mappings 
are  convex  processes,  and  if  S  and  T  are  normed,  we  have 
IIS  +  Tll  <  Ns ||  +  IItII  and  j| XT II  =  |x|  II T II .  One  can  also  define 
the  composition  of  two  convex  processes  in  the  obvious  way,  and 
Show  that  Hut II  <  Hull  IItII.  The  proofs  of  these  results  are 
omitted;  they  follow  from  the  important  fact  that  if  T  is  any  convex 
process  and  if  x  e  dom  T,  then  for  any  «  >0  there  is  (by  the 
definition  of  II T II )  some  y€  Tx  with 

II y II  <  IItII  llxll  +  *  . 
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Here  and  in  what  follows  we  are  using  the  convention  (+»)•()  =  0  =  0 

2.  Characterization  of  normed  convex  processes.  In  this 

section  we  first  give  an  example,  mentioned  in  the  introduction,  of 

a  closed  convex  process  with  infinite  norm;  we  then  show  that  the 

class  of  convex  processes  having  finite  norms  can  be  characterized 

in  terms  of  two  other  equivalent  topological  properties. 

The  example  is  as  follows:  let  T  be  the  convex  process  from 

2 

IR+  (the  non-negative  real  numbers)  into  ]R  given  by 


Tx 


{(y,  z)  |  y  <  zx  and  0  <  z}  for  x  >  0 
fi  for  x  <  0 . 


For  each  x  >  0,  the  image  Tx  is  the  area  in  the  yz-plane  on  or 
2 

above  the  parabola  y  =  zx;  TO  is  the  non-negative  z-axis.  It  is 
readily  verified  that  this  is  a  closed  convex  process  with  norm  0. 
However,  the  inverse  process  is  given  by 


T_1(y,z)  ={ 


{x  |  x  >  y  /z }  for  z  >  0  and  any  y 
]R+  for  z  =  0,  y  =  0 
ji  otherwise, 


and  since  for  the  pair  (1,  1/n)  we  have  T  V>  1/n)  =  {x  I  x  >  n),  it 
is  clear  that  the  norm  of  T  *  must  be  +  »  . 

Before  stating  the  characterization  theorem,  we  mention  some 
topological  preliminaries.  If  X  and  Y  are  topological  vector  spaces 
with  XQ  c  X,  and  if  T  is  a  mapping  from  X  into  Y,  we  say  that  T 
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is  lower  semlcontlnuous  at  xQ  e  XQ  as  a  mapping  from  XQ  to  Y  if 
for  each  open  set  Q  C  Y  with  0  H  TxQ  *  0,  there  is  an  open 
neighborhood  U  of  xQ  in  XQ  such  that  for  every  x  e  U,  Q  ft  Tx  *  0 
(see,  e.g.,  [2]).  We  say  that  T  is  open  at  0  if  the  image  under  T 
of  any  open  neighborhood  of  0  in  X  contains  an  open  neighborhood 
of  0  in  range  T.  When  we  speak  of  a  neighborhood  in  a  set  we 
are,  as  usual,  referring  to  the  relative  topology  on  that  set. 

THEOREM  1 :  Let  X  and  Y  be  normed  linear  spaces,  and  let  T  be  a 
convex  process  from  X  into  Y.  Then  the  following  three  properties  are 
equivalent; 

a.  T  has  a  finite  norm. 

b.  T  is  lower  semicontinuous  at  0  as  a  mapping  from  dom  T  into  Y. 

c .  T  1  is  open  at  0 . 

PROOF  (a  =>  c);  Denote  the  open  ball  of  radius  *  >  0  about  x  e  X 
by  B(x,  t),  and  let  C(y,  «)  be  a  similar  ball  about  ye  Y.  Let  D(x,  i) 

;=  B(x,  «)  fl  dom  T  and  R(y,  e)  :=  C(y,  «)  fl  range  T.  Let  V{0)  be  any  open 
neighborhood  of  0  in  Y;  then  T-1[V(0)]  =  T-1[V(0)  0  range  T] .  Pick 
some  n  >  0  such  that  C{0,  ti)  C  V(0);  then  R(0,  ti)  C  V(0)  (1  range  T.  Let 
e  >  0  be  so  small  that  ||t||  «  <  t/2.  Pick  any  x  e  D(0,  t);  then  there  is 
some  y  e  Tx  with  II y II  <  II T II  «  +  ri/2  <  n,  so  y  e  R(0,ri).  Since  x  was 
arbitrary,  it  follows  that  D(0, «)  C  T_1(R(0,t,)]  C  T-1[V(0)],  so  t"1 
is  open  at  0. 
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(c  — >  b):  Suppose  T  *  is  open  at  0;  let  Q  C  Y  be  open  with 
O  0  TO  *  0.  We  have  to  find  an  t  >  0  such  that  for  each  x  e  D(0,  «), 
we  have  Q  D  Tx  *  0.  Let  q  e  0  H  TO  and  suppose  C(q,  6)  C  Q  with  6  >  0. 

By  the  assumption,  there  is  an  «  >  0  such  that  T  *[R(0,  6)]  D  D(0,  «). 

But  then  for  any  x  e  D(0,  e)  there  is  a  y  e  Tx  fl  R(0,  6);  then  Tx  = 

T(0  +  x)  J  TO  +  Tx  3  q  +  y,  and  q  +  y  €  C(q,  6)  C  Q.  Hence  q  +  y  e  Q  fl  Tx  * 
and  so  T  is  lower  semicontinuous  at  0  as  a  mapping  from  dom  T  into  Y. 

(b  =>  a):  Suppose  T  does  not  have  a  finite  norm.  Then  we  can  find 

some  sequence  {x  }  C  dom  T  with  ||x  ||  <  1  and  ||y||  >  n  for  all  y  e  Tx 
n  n  =  =  n 

and  for  n  =  1,  2,  •  •  •  .  None  of  the  can  be  zero  (since  0  e  TO),  so  we 

can  define  a  new  sequence  (z  }  C  dom  T  by  setting  z  :=  x  /(n||x  ||)  for 

n  n  n  n 

each  n.  It  is  clear  that  II  z  ||  *  1/n  and  ||y||  >1  for  all  y  e  Tz  and  all  n. 

n  =  n 

Since  0  e  TO,  we  have  C(0,  1)  fl  TO  *  0;  however,  C(0,  1)  fl  Tz^  =  0 
for  each  n.  Since  {zn}  converges  to  zero,  it  follows  that  T  is  not  lower 
semicontinuous  at  0  as  a  mapping  from  dom  T  into  Y.  This  completes 
the  proof. 


3.  Sufficient  conditions  for  a  finite  norm.  In  Section  2  we  found 
necessary  and  sufficient  conditions  for  a  convex  process  to  have  a  finite 
norm.  However,  these  conditions  were  stated  in  terms  of  topological 
properties  of  T  which  will  frequently  be  just  as  hard  to  verify  as  will  be 
the  existence  of  a  norm.  In  this  section  we  deve’.op  some  sufficient 
conditions  of  a  simpler  kind,  which  involve  various  properties  of  dom  T. 
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THEOREM  2: (Generalized  Open  Mapping  Principle):  Let  X  and  Y 
be  Banach  spaces,  and  let  T  be  a  closed  convex  process  from  X  onto  Y. 
Then  the  image  under  T  of  any  open  set  in  X  is  an  open  set  in  Y. 

PROOF:  Let  the  neighborhoods  B,  C,  and  D  be  defined  as  in  the 
proof  of  Theorem  1.  We  shall  first  show  that  T  is  open  at  0;  the 
conclusion  of  the  theorem  then  follows  easily. 

We  have,  since  T  is  onto  Y, 

00  00 

Y  =  T(dom  T)  =  T[  U  D(0,  n) ]  =  U  T[D(0,  n)], 
n=l  n=l 

so  by  the  Baire  category  theorem  [  5  ]  there  is  some  N  such  that 
T[D(0,  N)]  contains  an  open  ball  in  Y,  say  C(p,  r|).  By  assumption  there 
is  some  x  e  dom  T  with  -p  e  Tx.  For  any  y  e  C(0,  n)  and  any  t  >  0,  we 
can  find  some  x'  e  D(0,  N)  and  z  €  Tx'  such  that  II  (p  +  y)  -z  ||  <  t;  then 
z  -  p  e  Tx'  +  Tx  C  T(x*  +  x)  l  T[D(0,  N  +  (| x  II ) ]  and  lly-(z-p)  II  = 

If  ( p  +  y)  -z  ||  <  t.  Thus  C(0,  n)  C  T[  D(0,  N  +  llxll)],  and  if  we  define 
6  :=  n/(N  +  ||x||)  it  follows  from  the  homogeneity  of  T  that  C(0,  6) 

C  T[  D(0,  1)],  and  in  fact  that  C{0,  2_k  6)  C  T[  D(0,  2_k) ]  for  k  =  0,  1, 
Choose  an  arbitrary  y  e  C(0,  6/2);  then  by  the  last  observation  we  can 
find  some  x^  e  D(0,  \)  and  yj  e  TXj  such  that  II y  -  y^  II  <  6/4.  Suppose 
that  for  some  k  >  l  we  have  x^,  •  • . ,  x^  and  y^,  •  •  • ,  y^  with  x^  e  D(0,  2 

k  .. 

and  y  e  Tx  for  each  ),  and  with  ||y-  ^  y  ||  <  2  1  6.  Then  we  can 

J  j  j=l  ] 
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find  an  xk+J  t  D(0,  2  *k+1^)  and  yk+J  €  Txfc+1  with 

II  (y  -  E  y,>  -  yk II  --By-  E  y,  II <  2  (k+^  6- 

i  =  i  1  k  1  i=i  ] 

Hence,  by  induction  we  can  construct  sequences  {x.  }  and  {y  }  having 

v  J  V 

the  stated  properties  for  each  j.  Let  w  :  =  x  anc*  zit  :=  u  y<  l°r 

K  j  =  l  J  j  =  l  ' 

k  =  1,  2,  •  •  •  .  It  is  easily  seen  that  {wkl  is  a  Cauchy  sequence 

and  therefore  must  converge  to  some  x  (since  X  is  complete). 

Also,  by  construction  { }  converges  to  y.  We  have  for  each  k, 

k  k  k 

tw  =  k  E  *  E  Txj  *  E  y*  =  V 

1  =  1  1  1=1  1  1=1  J 

so  the  pair  (wk,  zk)  belongs  to  the  graph  of  T.  Since  T  was  assumed  to 

be  a  closed  mapping,  it  follows  that  (x,  y)  also  belongs  to  graph  T, 

or  in  other  words,  that  y  £  Tx.  Thus  x  e  dom  T,  and  since  for  each  j, 

00 

II x .  II  <  2  we  must  have  II x  II  ^  2^  =  1.  Hence  x  €  D(0,  1),  and 

1  jO 

since  y  was  an  arbitrary  element  of  C(0,  6/2)  we  have  shown  that 

T[  D(0,  I) )  ->  C(0,  6/2);  therefore  T  is  open  at  0. 

Now  let  0  be  any  open  set  in  X.  Let  y  be  any  point  of  T(0),  and 

let  x  €  0  be  such  that  y  €  Tx.  Choose  *  >  0  so  that  B(x,  O  C  Q-  Then 

T(Q)  T[B(x,  «)1  =  T[  x  +  B(0,  01  -  Tx  +  T[  B(v,  01 

=  Tx  +  T(D(0,  «)1  >  y  +  C(0,  6t/2)  =  C(y,  6«/2), 

so  T(Q)  must  be  open.  This  completes  the  proof. 
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COROLLARY  (Generalized  Closed  Graph  Theorem):  Let  X  and  Y 
be  Banach  spaces,  and  let  T  be  a  closed  convex  process  from  X 
into  Y.  If  dom  T  =  X,  then  T  has  a  finite  norm. 

PROOF:  The  convex  process  T  *  takes  Y  onto  X,  and  is  closed 
since  its  graph  is  a  reorientation  of  that  of  T.  Applying  Theorem  2 
to  T  \  we  conclude  that  T  *  is  open  at  0;  it  follows  from  Theorem  1 
that  T  must  then  have  a  finite  norm. 

It  is  not  true  that  if  dom  T  =  X  and  T  has  a  finite  norm,  then 
graph  T  is  closed.  For  example,  the  convex  process  from  R  into 
IR2  given  by  Tx  :=  {(y,  z)|y>0,  z  >  0}  U  {0,0}  for  each  x,  has 
domain  ]R  and  norm  equal  to  zero,  but  its  graph  is  not  closed. 

The  following  theorem  is  often  useful  in  dealing  with  systems 
of  linear  equations  and  inequalities  in  finite-dimensional  spaces. 

THEOREM  3:  Let  X  and  Y  be  normed  linear  spaces,  and  let  T  be 
a  convex  process  from  X  into  Y.  If.  dom  T  is  the  sum  of  a  finite  number 
of  half- lines,  then  T  has  a  finite  norm. 

PROOF:  Let  dom  T  be  the  sum  of  n  half-lines.  If  n  =  0,  then 

dom  T  =  {0}  and  it  is  easily  seen  that  {j T II  =  0.  Suppose  then  that 

n>  0,  that  there  *xist  vectors  x.,  •  •  • ,  x  with  ||xJ  II  =  1  for  each  1,  and 

n  J  n 

that  any  x  e  dom  T  is  representable  in  the  form  x  =  2]  X.x  with  each  \ 

J=1  ]  ]  ] 

non-negative.  Then  dom  T  lies  in  the  subspace  V  generated  by  Xj,  •••,  x^, 
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and  this  subspace  has  dimension  no  higher  than  n.  The  restriction  of 
the  norm  ||  ||  of  X  to  V  is  a  norm  on  V.  Define  a  function  f(x)  on  dom  T  by 

f(x)  :=  inf  {  ||y  II  j  y  e  Tx}. 

It  is  clear  that  f(x)  has  a  finite  value  at  each  point  of  dom  T;  in  fact,  as 

we  shall  see  in  the  following  argument,  it  is  even  convex  there.  Let 

Xj  and  x^  be  any  two  points  of  dom  T;  let  e  >  0  be  arbitrary,  and  pick 

yJ  e  TXj  and  y2  e  Tx£  with  ||  ||  <  f{Xj)  +  £  and  y£  <  f^)  +  t .  For  any 

\  e  [0,  1]  we  have  ^  +  (l-\)y2  €  X  Tx1  +  (l-\)  Tx2  C  T[\x1  +  (l-\)x2], 

so  f[\x1  +  (l-\)  x2]  <  ||\y1  +  (l-\)  y2||  <  \  HyJI  +  (l-\)  HyJI 

<  \[f(xp  +  t]  +  (l-\)  [f(X2^  +  «  ]  =  X  f(xj)  +  (1-X)  f(x2)  +  £-  Since  e  was 

arbitrary,  it  follows  that  f(x)  is  convex  on  dom  T. 

Let  II  ||  be  any  polyhedral  norm  on  V  (that  is,  any  norm  whose 

closed  unit  ball  is  a  polyhedron).  Since  dom  T,  being  the  sum  of  a  finite 

number  of  half-lines,  is  a  polyhedral  convex  cone  [  3  ),  the  intersection 

B  fl  dom  T  will  be  a  polyhedron  (nonempty,  since  0  e  B  0  dom  T). 

P  p 

Therefore  f(x),  being  convex,  must  attain  its  maximum  at  one  of  the 

extreme  points  of  D  dom  T,  so  the  quantity 

sup  { inf ( II y ||  y  e  Tx)  ||x||  <1,  x  e  dom  T} 

P  = 

=  sup  |f(x)  x  e  B  D  dom  T} 

P 

is  finite.  However,  since  V  is  of  finite  dimension  the  norms  II  II  and 
II  llp  are  equivalent  on  V  [2],  and  thus 

PtII  sup  iinf {  llyll  y  e  Tx)  llxll  <  1,  x  t  dom  T} 
is  also  finite.  This  completes  the  proof. 
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The  next  theorem  is  a  partial  converse  to  Theorem  3.  In  the 


theorem,  we  shall  speak  of  an  extreme  half-line  in  a  cone;  this 

term  4s  to  be  understood  to  mean  a  half- line  (from  0)  in  the  cone  which  is 

not  the  sum  of  any  two  distinct  half-lines  in  the  cone. 

THEOREM  4:  Let  X  be  a  normed  linear  .pace  and  let  K  be  a 
convex  cone  containing  the  origin  in  X.  If  K  contains  an  infinite 
number  of  extreme  half-lines,  then  there  is  a  convex  process  having 
domain  K  whose  norm  is  +°°. 

PROOF:  Let  {L  }  be  a  sequence  of  extreme  half-lines  in  K. 
n 

Define  a  function  g(x)  on  K  as  follows:  if  for  some  n,  x  e  L^, 

then  g(x)  :=  n  ||x||;  otherwise  g(x)  :=  0.  Let  p^  and  p2  be  any 

two  distinct  points  in  K.  If  p^,  p ^  and  0  are  not  collinear,  then 

the  "open"  line  segment  (p^,  P2)  cannot  contain  any  point  lying  on 

an  extreme  half-line,  so  g(x)  is  zero  on  the  entire  segment  and 

hence  convex  on  the  closed  segment  [  p^,  p2J.  If  p^,  p2  and  0 

are  collinear,  then  by  enumeration  of  cases  g(x)  is  easily  seen  to 

be  convex  on  [  p^(  p2] .  Thus  g(x)  is  a  convex  function  on  the  cone  K. 

Now  for  x  e  K  define  Tx  :=  (X  e  IR  |  X  >  g(x)},  or  in  the  notation 

of  l  9  ],  Tx  :=  g(x)v.  Since  g  is  positively  homogeneous  and  convex, 

with  y(0)  =  0,  the  epigraph  [10]  of  g  is  a  convex  cone  containing  the  origin; 

but  this  is  also  the  graph  of  T,  so  T  is  a  convex  process  with  dom  T  =  K. 

Consider  the  points  x  defined  by  x  t  L  and  ||x  II  =  1.  For  each  n 

n  n  n  n 

we  have  inf  {  II y  II  I  y  €  Tx  }  -  n,  so  it  follows  that  |f  T (j  =  +»,  as 

n 

was  to  have  been  shown. 
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4.  Perturbation  of  a  convex  process-  In  this  section  we  shall 
obtain  bounds  for  the  norm  of  the  inverse  of  a  perturbed  convex  process 
in  terms  of  the  norm  of  the  inverse  of  the  unperturbed  process  and  the 
norm  of  the  perturbing  process,  the  latter  being  assumed  to  be  small. 
These  bounds  will  be  applied  in  the  following  section  to  develop  a 
stability  theory  for  certain  operator  inequalities  and  equations.  The 
results  we  shall  obtain  here  generalize  the  well-known  norm  bounds  for 
perturbations  of  a  non-singular  linear  operator  mapping  a  Banach  space 
into  itself. 


If  T  is  a  convex  process  and  K  is  a  convex  cone  containing 
the  origin,  then  we  shall  denote  by  the  restriction  of  T  to  K; 
that  is,  the  convex  process  defined  by 


space.  Let  T  and  A  be  convex  processes  from  X  into  Y;  denote 
dom  T  to  K  And  range  T  by.  R.  Assume  that  T,  T  ,  and  A  are 
normed,  and  that  II T_1 1|  ||a  II  <  1  .  Suppose  further  that  K  C  dom  A, 
A(K)  c  R,  k  Is  closed,  and  (T-A)(x)  is  closed  for  each  x  e  K. 
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PROOF:  Let  t  :=  ||  T  i  II  and  6  t=  II  a||.  Let  ye  range  T 
and  <  >  o  be  chosen  arbitrarily,  and  let  0  be  any  positive  real  number 
with  t6  <  0  <  1.  We  shall  construct  a  Cauchy  sequence  {x^}  converging 
to  a  vector  x  e  K  with  the  property  that  ?  e  (T  -  A)  x,  showing  that 
range  T  C  range  (T  -  A),  and  with  ||x||  <  t(1  -  0)  *  ||y  II  +  e(l  -  0) 

It  will  follow,  upon  letting  «  10  and  0  1t6,  that  ||(T  -  A)^||  <  t/(1  -  t6). 

The  number  0  is  introduced  in  order  to  deal  with  the  exceptional  case 
in  which  t6  =  0. 

To  construct  the  sequence  {x^}  we  proceed  inductively,  beginning 
with  the  choice  xQ  =  0.  Next,  using  the  fact  that  y  e  range  T  and  the 

definition  of  t,  we  choose  x^  e  K  such  that  y  e  Tx^  and  ||xj  II  <  r  ||y  j|  +  e  /2. 

Then  the  following  three  statements  hold: 

■ 

1  '  Xl  ~  xo  €  K* 

2.  ||xA  -  xQ  ||  <  T0°  ilyll  +  «(1  -  2  1)e°. 

1 

3.  (TXj  -  y)  fl  AxQ  *  0  (it  contains  0). 

Now  let  k  >  1,  and  suppose  that  x^_j  and  x^  are  given  with  x^  ^  and 
in  K  and  the  following  conditions  satisfied: 

*■  \-Vi€K- 

z'  ^xk  "  yK-i^  - T0k_1  Ilyll  +  ‘U  -  2"k) 0k-1- 

3-  (Txk  -  y)  fl  Axk  l  *  0. 

Let  n  and  r\  be  positive  real  numbers  with  the  property  that  Trc  +  n  = 

l  C  1  L 

k  k+1 

0  «  /2  Since  x^  -  x^_^  €  K,  the  set  d(xk  “  Xk-P  is  nonemPty!  let 
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z  be  a  member  of  this  set  with  Hz  II  <  6  j|x^  -  II  +  t^.  Next  select 
w  e  K  such  that  z  e  Tw  and  l|w||  <  t  ||z||  +  r^.  Let  x^+j  :=  x^  +  w. 

Clearly  x^  -  x^  e  K,  and  we  have,  using  the  second  induction  hypothesis 
and  the  definition  of  rj  and  r\^. 


k  = 


<  t  || Z  II  +  r\2  £  T&  || x^  -  Xk  lH  +  tt^  +  r|2 


£  6  ||xk  -  xk_iH  +  0k  e/2k+1 

<r9k  llyil  t«(i-2-k)  ek  +  <  2-,ktl)ek 

=  T6k  Hyi  t<(l-2-(k+1))6k. 


Finally,  let  p  be  any  member  of  the  set  (Txk  -  y)  H  Axk  which  was 

assumed  to  be  nonempty.  Then 

p  +  z  6  Axk_x  +  A(xk  -  xk_1)  C  Axk, 

and  since  w  =  x,  -  x  , 
k+1  k 

p  +  z  e  (Txk  -  y)  +  T(xk+1  -  xk)  C  Txk+J  -  y, 

so  that  the  set  (Tx,  -  y)  fl  Ax,  is  nonempty.  Thus,  by  induction  the 
k+1  k 

properties  (1),  (2),  and  (3)  must  hold  for  k  =  0,  1,  2,  •  •  •  .  We  therefore 
have  for  m  >  1, 

m-1 

,xk«-xkl|s  20  ,JWi '  *ic*j 1 


<  L1  [t  By  II  +  .(1  -  2-<k+t*»)l  ek+i 
j  =  0 


m-1  . 

<  (T  llyil  +  <)  I  ek+i 
1  =  0 

=  ek  (T  llyil  +«)(i-  em)/(i  -  e), 


(l) 
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and  the  latter  quantity  converges  to  zero  ask-*<»,  regardless  of  m.  Thus 


is  a  Cauchy  sequence. 


For  each  k,  =  x^  + 


k-1 

<x<+1 '  / • 


a  finite  sum  of  terms  in  K;  hence  {x^}  C  K.  Since  X  is  a  Banach  space 

and  K  was  assumed  to  be  closed,  the  sequence  {x  }  converges  to  some 

k 

x  e  K. 


Now  choose  an  arbitrary  6  >  0,  and  let  k  be  so  large  that  we  have 

max  [  (  ||  T II  +  ||  All)  llx  -  XjJI,  II  A  II  II  x^  -  x^_^  ||  ]  <  6/4.  Since  x  -  x^ 

is  the  limit  of  the  sequence  {xk  -  x^}  as  j  -*«,  and  since  for  each  j, 

i-.1 

Xk+j  '  xk  =  (xk+i+l  '  xk+iJ  e  K’  ^  P°int  X  “  Xk  lieS  in  K'  Therefore 

(T  -  A)(x)  -  y  D  (T  -  A)(x  -  xk)  +  (T  -  A)(xk)  -  y 

C  (T  -  A)(X  -  xk)  +  {[Txk  -  y]  -  Ax^}  -  A(xk  -  xk_1) 

3  (T  -  A)(x  -  xk)  -  A^  -  xk-1), 

the  last  inclusion  following  since  0  e  (Txk  -  y)  -  Axk_^  by  property  (3) 
of  the  induction.  As  noted  in  Section  1,  we  have  It  T  -  A  ||  <  I|t||  +  ||  All, 

so  we  can  select  z^e  (T  -  A)(x  -  xk)  with  ||  z^  ||  <  (  II T II  +  II  A  II )  llx  -  xk  II  + 

6/4  <  6/2,  and  -  A(xk  “  j)  with  llz^ll  <  II  A  II  ||xk  -  II  + 

6/4  <  6/2.  Therefore  z^  +  z^  e  (T  -  A)(x)  -  y  with  ||z^  +  ||  <  6,  but 

since  6  was  arbitrary  and  (T  -  A)  x  was  assumed  to  be  closed,  we  must 
have  y  e  (T  -  A)  x  .  Since  y  was  an  arbitrary  element  of  range  T,  we 
have  range  T  C  range  (T  -  A). 
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Taking  k  =  0  and  letting  m  -*»  in  (1),  we  obtain 


|j  x  II  -  ||  X  -  xQ  ||  <  (t  ||  y  II  +  0/(1  -  9)-  Since  t  was  arbitrary,  we  have 


inf  {  I1  x  ||  |  y  e  (T  -  A)  x  }  <  [t/(1  -  9)]  ||y||,  and  since  y  was  any  element 
of  rar.ye  T,  we  see  that  ||(T  -  A)  1  U  <  r/(l-9). 

Letting  9  1 16,  we  obtain  ||(T  -  A)  M  <  ~r/[l  -  t6),  as  was  to  have  been 

R  = 


shown. 

It  is  not  difficult  to  see  that  the  conclusion  of  this  theorem  fails 

if  the  process  (T  -  A)  *  is  not  restricted  to  range  T.  For  example,  if 
2 

X  =  Y  =  1R  with  the  <  norm,  and  if  we  set 

00  ’ 


Tx  :=  { 


1  0 
0  0 


x} 


and 


Ax  ;=  { 


5 

0 


x} 


for  every  x  e  IR2,  then  ||t||  =  II T  1 II  =  1,  II  A  II  =  £,  but  ||(T  -  A)  *||  =  10. 
However,  ||(T  -  A)  Ml  =  2,  as  stated  in  the  theorem. 

For  the  case  in  wnich  T  and  A  are  continuous  linear  operators 
from  a  Banach  space  into  itself  with  T  and  T  -  A  invertible,  we  can 
obtain  also  a  lower  bound  for  II (T  -  A)  Ml,  namely: 

||(T  -  A)-1 1|  >  ||t_1  11/(1  +  IIt-1  II  II  All).  (2) 

However,  this  inequality  is  generally  false  for  convex  processes.  For 
example,  let  X=Y=1R,  and  let  T  be  the  identity  mapping  on  IR .  Let 
A  be  defined  by  Ax  :=  IR  for  each  x  e  IR  .  Then  II T II  =  II T  Ml  =  1, 
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but  || (T  -  A)-1  II  =  0,  so  the  inequality  (2)  does  not  hold.  In  order 
to  be  able  to  prove  that  (2)  is  valid,  we  require  additional  conditions. 

We  have  followed  Rockafellar  [10]  in  denoting  by  0+  S  the  recession 
cone  of  a  convex  set  S:  that  is,  the  cone  made  up  of  all  points  x 
with  the  property  that  x  +  S  C  S.  Intuitively,  this  is  the  "set  of 
directions  in  which  S  is  unbounded.  " 

To  establish  (2),  we  first  note  that  if  II  (T  -  A)  *  II  =  +  00 
there  is  nothing  to  prove,  and  that  if  II (T  -  A)  *  ||  II  A  ||  >  1  the 
inequality  follows  from 

ll(T  -  A)_1 1|  >  || T_1 1|  (1  -  II  All  ||(T  -  A)_1 1|),  (3) 

which  is  equivalent  to  (2).  We  need  therefore  be  concerned  only 
with  the  case  in  which  ||(T  -  A)  *  ||  ||  A  ||  <  1.  If  we  now  assume 
that  for  each  x  e  dom  T  fl  dom  A,  we  have 

'  A-  A)  x  C0+  Tx,  (4) 

it  follows  that  for  each  such  x,  (T  -  A)x  -  (-  A)x  C  Tx;  but  since 
0  e  (A- A)x,  the  reverse  inclusion  is  trivial.  Therefore  we  have 

(T  -  A)  -  (-  A)  =  T, 

and  now  by  making  the  assumptions  necessary  to  apply  Theorem  5 
to  T  -  A  and  -  A,  and  by  assuming  that  T  -  A  is  onto,  we  can 
establish  (3),  from  which  (2)  follows. 

We  remark  that  (4)  is  always  satisfied  when  A  is  a  single¬ 
valued  function. 
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5.  Action  of  a  convex  process  on  sets.  In  this  section  we 


examine  the  following  question:  if  two  sets  P  and  0  are  "close" 
to  each  other  (in  a  sense  to  be  made  precise),  and  if  these  sets 
are  mapped  by  a  convex  process  T  into  sets  TP  and  TQ,  then 
how  "close"  to  each  other  are  TP  and  TQ? 

We  first  consider  a  measure  of  the  distance  between  two  sets. 
If  Z  is  a  normed  linear  space,  we  define  for  any  z  e  Z  and  any 
nonempty  subset  A  C  Z, 


d(z,  A)  :=  inf{  || z-a  |j 
For  any  nonempty  set  B  C  Z,  define 

d(B,  A)  :=  sup{d(b,A) 


a  e.  A)  . 

b  e  B}. 


If  we  now  let 


p(A,B)  :=  max{d(A,  B),  d(B,  A) }, 

then  p  is  a  generalized  pseudo-metric  on  the  family  of  nonempty 
subsets  of  Z;  that  is,  a  pseudo-metric  [6]  which  may  assume  the 
value  +  « .  If  A  and  B  are  required  to  be  closed,  then  p  is  the 
Hausdorff  metric  [  2] . 


THEOREM  6;  Let  X  and  Y  be  normed  linear  spaces.  Let  P 
and  Q  be  nonempty  subsets  of  X,  and  let  T  be  a  normed  convex 
process  from  X  into  Y,  with  TP  and  TQ  nonempty, 
a.  If  Q-PC  dom  T,  then 

d(TP,  TQ)  <  ilT ||  d(P,  Q). 
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b.  If  (Q-P)U(P-Q)  C  dom  T,  then 

p(tp,  to)  <  IItII  p(P,  Q). 

PROOF:  We  shall  prove  (a.);  (b.)  then  follows  by  symmetry. 
Choose  «  >  0,  and  let  y  be  any  point  in  TP.  Let  p  e  P  be  such 
that  y  e  Tp,  and  find  some  q  e  Q  with  ||t||  ||p-q||  <  II T it  d(P,  Q)  +  «/2. 
Since  Q-P  c  dom  T,  there  is  some  y1  e  T(q-p)  with 

II y' II  <  IItII  II q— p II  +  </2. 

Then 


Tq  -  y  O  T(q-p)  +  Tp  -  y 

9  y*  +  y  -  y  =  y» 


and 

lly'll  <  IItII  llq-pll  +  «/2  <  ||t||  d(p,Q)  +  *. 

Therefore 

d(y,  TQ)  :=  inf{l|z-y||  |  z  e  TQ} 

=  inf{  || w ||  j  w  e  TQ  -  y} 

<  IItII  d(P, Q)  +  I, 

and  since  y  was  any  element  of  TP,  we  have  d(TP,  TQ)  <  II T ||  d(P,  Q)  +  e. 

But  «  was  arbitrary,  so  the  result  follows.  This  completes  the  proof. 

If  the  conditions  on  the  difference  of  Q  and  P  are  not 

satisfied,  then  the  conclusions  of  Theorem  6  can  fail  to  hold.  This 

can  be  seen  by  considering  the  following  example:  define  a  convex 
2 

process  T  from  ]R  (with  the  i  norm)  into  IR  by: 
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p  {z  iz  >  o }  for  y  >  0 

T(x,  y)  :=(  (ziz  >  |x!)  for  y  =  0 

0  for  y  <  0  . 

It  is  easy  to  verify  that  ||t||  =  1.  However,  for  any  «  >  0  we  have 
d[T(l,  «),  T(1,0)]  =  1,  although  d[  (1,  «),  (1,0)]  =  |c|,  so  that  the 
conclusions  of  Theorem  6  do  not  hold.  In  this  case,  the  difficulty 

arises  from  the  fact  that  (0,  -«)  is  not  in  dom  T  for  e  >  0. 

6.  Stability  of  solution  sets  of  certain  systems.  Suppose  that 
we  are  given  three  Banach  spaces  X,  Y,  and  Z,  and  that  Y  contains 
a  nonempty  closed  convex  cone  K  which  induces  on  Y  a  partial  ordering 
denoted  by  <  .  Let  A  be  a  function  from  X  into  Y  which  is  convex  with  respect 
to  K  on  all  of  X  and  is  closed  and  positively  homogeneous  of  degree  1; 
that  is,  epi  A  is  closed  in  XxY  and  for  each  real  X  >  0  and  each 
x  e  X  we  have  A(Xx)  =  \Ax.  In  particular,  A  could  be  a  continuous 
linear  operator.  Let  A  ,  C,  and  A  be  continuous  linear  operators 
from  X  into  Y,  Z,  and  Z  respectively.  Suppose  b  and  A^  are 
points  in  Y,  and  d  and  A^  are  points  In  Z.  We  shall  consider 
the  following  two  questions: 

a.  Suppose  x  is  a  solution  of  the  system 

Aw  <  b 

Cw  =  d  .  (5) 

A  A 

Is  there  any  x  e  X  such  that  x  solves  the  system 
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(6) 


(A  +  A.) w  <  b  +  A. 

A  =  d 

(C  +  Ac)w  =  d  +  Ad  , 

and  if  so  how  small  can  ||x-x||  be  made;  i.e. ,  how  close  to  x 
is  there  a  solution  of  (6)  ? 

b-  Suppose  x  solves  (6).  If  (5)  is  known  to  be  solvable,  how 
close  is  x  to  the  set  of  solutions  of  (5)  ? 

Question  (a. )  is  one  that  frequently  arises  in  such  areas  as  the 
analysis  of  convergence  for  iterative  processes  (see,  e.g.,  [8]). 
Question  (b.)  formulates  the  fundamental  problem  of  determining 
error  bounds  for  the  approximate  solution  of  certain  systems  (including 
linear  systems).  We  shall  see  that  both  questions  can  be  answered 
in  a  convenient  way  by  applying  Theorem  6  and  some  of  our  previous 
results. 

THEOREM  7:  Let  X,  Y  and  Z  be  Banach  spaces,  and  let  K  be 
a  nonempty  closed  convex  cone  in  Y.  Let  the  partial  ordering 
induced  on  Y  by  K  be  denoted  bv  <  .  Let  A,  AA,  C,  Ac>  b,  A^,  d 
and  Ad  be  as  previously  stated.  Define  a  multivalued  mapping 
from  X  into  Y  x  Z  by 

Tx  ;=  {(y,  z)  |  Ax  <  y,  Cx  =  z} 
and  a  linear  operator  from  X  into  Yx  Z  bv 

Ax  :=  {{Aax,  Aqx)}  . 

L§t  YxZ  be  normed  by  defining  ||(y,  z)||  ;=  max  ( lly  II ,  llzll),  where 
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the  norms  on  the  right  are  those  of  the  spaces  Y  and  Z  respectively. 


Suppose  the  mapping  T  carries  X  onto  Yx  Z.  Then  T,  T  M  and  A  are 
normed  convex  processes,  and  we  have: 

a.  _If  x  solves  (fe).  then 

inf  {  f|x-x  ||  x  solves  (5)}  <  ||T  Ml  (ll(Ab,Ad)||  +  ||a||  ||x||). 

b .  If  x  solves  (5)  and  II A )|  II T  Ml  <  1,  then  (fe)  is  solvable 
and  we  have 

inf {  llx-x  II  x  solves  (6)}  <  II T  Ml  (II (A  ,  A  )  ||  +  ||aH  ||x||)/(1  -  ||a||  ||t  Ml). 

=  b  a 


PROOF:  It  is  a  fairly  routine  matter  to  show  that  Yx  Z  is  a 
Banach  space  under  the  given  norm,  and  that  its  topology  is  in  fact 
the  product  topology  on  YxZ-  The  assertion  that  T,  T  \  and  A 
are  convex  processes  is  easily  proved  by  referring  to  the  definition 
of  a  convex  process,  and  the  fact  that  A  is  normed  follows  from  the 
continuity  (thus  boundedness)  of  A  and  A_;  indeed,  we  have 
IIa  II  =  max  (  H  aaII,  II  Ac  ||).  The  assumption  that  epi  A  was  closed, 
and  the  continuity  of  C,  imply  that  graph  T  is  closed  in  Xx  Yx  Z; 
hence  T  and  T  1  are  closed  convex  processes.  Since  dom  T  =  X 
and  dom  T  1  =  range  T  =  Yx  Z,  it  follows  from  the  corollary  to 
Theorem  2  that  T  and  T  *  are  normed. 

For  part  (a.),  we  rewrite  (6)  with  w  =  x  to  obtain 

Ax  <  b  +  A.  -  A.x 
=  b  A 

Cx  =  d  +  A  .  -  A  x  . 

d  c 
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Thus 


x  e  T-1[  (b,  d)  +  (Afa,  Ad)  -  Ax]  , 

and  since  the  set  of  points  x  solving  (5)  is  T  *[(b,d)],  we  may 
apply  Theorem  6  to  obtain 

inf{  |fx-x!|  |  x  solves  (5)}  =  d(x,  T_1[  (b,  d)  ] ) 

i  d(T_1[  (b,  d)  +  (Ab,  Ad)  -  Ax],  T-1[(b,d)]) 

<  llT'Ml  i(Ab,  Ad)  -  Ax  8 

<  At-1  8  (B(Ab,Ad)||  +  tl a 8  8x||). 

This  proves  part  (a.). 

To  prove  part  (b.),  we  shall  apply  Theorem  5  to  the  convex 
process  T  +  A  =  T-(-A).  We  observe  that  dom  (-A)  =  dom  T  =  X, 
which  is  closed;  also  -A(X)  C  Yx  Z  =  range  T.  We  showed  earlier 
in  the  proof  that  T  *  was  normed,  and  we  had  by  hypothesis  that 
At  1 II  II -A  8  =  II T  *||  ||  A  ||  <1.  Finally,  for  each  xe  X  the  set 
(T  +  A)x  is  {Ax  +  A^x  +  K}  x  {Cx  +  Acx},  which  is  a  closed  set  in 
YX  Z. 

We  now  apply  Theorem  5,  and  conclude  that  range  (T  +  A)  =  Yx  Z, 
so  that  (6)  is  solvable  for  any  right-hand  side.  Also,  we  have 

1  (r  +  af'l  <  Hr"1  |l/(i  -  ||  t'1#  II  a  III; 

no  restriction  ol  (T  +  A)  *  is  necessary,  since  T  was  onto  Yx  z. 
Rewriting  (5)  with  w=X,  we  obtain 

(A  +  Aa)x  <  b  +  Aax 
(C  +  Ac)x  =  d  +  Acx  ; 
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that  is, 


x  e  (T  +  A)  1  [(b,d)  +  Ax]. 

Reasoning  as  we  did  in  part  (a.),  we  find  that 

inf  { || x  ~x  ||  x  solves  (6)}  =  d(x  ,  (T  +  A)  1  [  (b,  d)  +  (Afa,  Ad)]) 

J  II {T  t  A)‘l|l  ll(Ab,Ad)  -  Axil 
<  llT-'ll  (|l(Ab,  Ad)  II  t  II A II  |SH)/<1  -  II T" 1 II  II A  II ) , 

as  was  to  have  been  shown. 

If  the  space  X  is  reflexive,  then  the  infima  in  the  conclusions 
of  Theorem  1  are  actually  attained,  since  the  norm  is  weakly  lower 
semicontinuous .  If  all  spaces  involved  are  finite-dimensional, 
and  if  A  is  taken  to  be  linear,  then  a  result  similar  to  part  (a.)  can 
be  proved  with  no  assumptions  at  all  about  the  ranges  of  A  and  C. 

This  type  of  result  was  apparently  first  proved  by  Hoffman  [  4]; 
see  [7]  for  a  treatment  using  the  methods  of  the  present  paper,  with 
applications  to  linear  programming,  and  [8]  for  an  application  to 
Newton's  method.  A  theorem  similar  to  part  (b.)  of  Theorem  7 
(again  with  A  assumed  to  be  linear)  was  proved  for  finite-dimensional 
spaces  in  [8];  also,  Ben-Israel  proved  analogous  perturbation 
results  for  generalized  inverses  in  finite-dimensional  spaces  in  [1]. 

The  results  of  Theorem  7  are  expressed  in  terms  of  the  quantity 
II T  Ml,  defined  in  this  case  to  be 

sup{inf  { II x ||  I  Ax  <  y,  Cx  =  z}  I  ll(y,z)H  <  1}  .  (7) 
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Even  In  the  finite-dimensional  case,  this  quantity  can  be  rather 
difficult  to  compute.  It  would  be  very  desirable  to  have  efficient 
computational  methods  for  evaluating  {7),  both  in  the  finite¬ 
dimensional  and  infinite-dimensional  cases. 
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